UNCLASSIFIED 


Defense  Technical  Information  Center 
Compilation  Part  Notice 

ADP013756 

TITLE:  Approximation  Error  Maps 

DISTRIBUTION:  Approved  for  public  release,  distribution  unlimited 


This  paper  is  part  of  the  following  report: 

TITLE:  Algorithms  For  Approximation  IV.  Proceedings  of  the  2001 
International  Symposium 

To  order  the  complete  compilation  report,  use:  ADA412833 

The  component  part  is  provided  here  to  allow  users  access  to  individually  authored  sections 
of  proceedings,  annals,  symposia,  etc.  However,  the  component  should  be  considered  within 
the  context  of  the  overall  compilation  report  and  not  as  a stand-alone  technical  report. 

The  following  component  part  numbers  comprise  the  compilation  report: 

ADP013708  thru  ADPO 13761 


UNCLASSIFIED 


Approximation  error  maps 

A.  Gomide  and  J.  Stolfi 

Institute  of  Computing,  University  of  Campinas,  Brazil. 

anamariaOic . unicamp . br,  stolf i@ic . unicamp . br 


Abstract 

In  order  to  analyze  the  accuracy  of  a fixed,  finite-dimensional  approximation  space  which 
is  not  uniform  over  its  domain  Cl,  we  define  approximation  error  map,  a description  of 
how  the  error  is  distributed  over  Cl — not  for  a single  test  function  but  for  a general  class 
of  such  functions.  We  show  how  to  compute  such  a map  from  the  best  approximations 
to  an  orthonormal  basis  of  the  target  function  space. 

1 Introduction 

The  expected  accuracy  of  a finite-dimensional  approximation  space  (e.g.  a polynomial 
spline  space,  or  a finite  wavelet  decomposition)  will  often  vary  over  its  domain  Cl.  Indeed, 
adaptive-resolution  schemes  are  based  on  the  premise  that  refining  the  element  grid  in 
a particular  region  of  fl  will  improve  the  approximation  accuracy  in  that  region. 

Knowledge  of  how  the  expected  approximation  error  varies  over  the  domain  fl  is 
obviously  relevant  to  the  evaluation  of  an  approximation  space,  and  to  the  tuning  of  knot 
locations,  grid  geometry,  refinement  thresholds  and  other  parameters.  Towards  that  goal, 
we  introduce  the  concept  of  approximation  error  map,  a description  of  how  the  error  is 
distributed  over  fl — not  for  a single  test  function,  but  for  all  functions  in  some  specified 
space  T.  We  then  show  how  to  compute  such  a map  from  the  best  approximations  to 
an  orthonormal  basis  of  T . 

1.1  Notation  and  definitions 

Let  T and  A be  two  fixed,  finite-dimensional  vector  spaces,  not  necessarily  disjoint,  of 
functions  defined  on  some  domain  fl  with  values  in  R.  Let  ||-||  be  a vector  semi-norm 
for  the  space  A + T.  For  any  function  / 6 T,  we  define  its  best  approximation  as  the 
function  fA  6 A that  minimizes  the  error  J/  — fA\\. 

We  refer  to  A and  T as  the  approximation  and  gauge  spaces,  respectively.  We  assume 
that  the  ||-||-balls  in  the  subspace  A are  strictly  convex,  ensuring  that  the  best  approx- 
imation always  exists  and  is  unique.  Since  (a/)-4 . = a(/v4)  and  ||a/||  = |a|  ||/||  for  any 
real  constant  a,  we  can  confine  the  analysis  of  approximation  errors  to  the  unit  A -sphere 

F\  = {f  &F  ■■  ||/||  = 1}- 

1.2  Global  error  measures 

Usually,  the  effectiveness  of  the  approximation  space  A is  measured  by  a single  number 
! j / — fA || — either  for  the  worst-case  function  / 6 T\,  or  by  the  root-mean-power  average 
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(1.1) 


(1.2) 

1.3  Uniform  approximation  spaces 

A global  error  measure  such  as  p*A:F  or  a*  A T is  generally  sufficient  when  all  points  of  ft 
are  equivalent  with  respect  to  the  quality  of  approximation.  More  formally,  we  say  that 
a normed  function  space  X is  uniform  over  ft  if  there  is  some  family  $ of  maps  from  ft 
to  ft  that  preserves  X and  its  norm  ||-||,  and  which  can  take  any  point  of  ft  to  any  other 
point.  A natural  example  is  yd,  the  set  of  all  harmonic  functions  on  the  sphere  Sd  of  a 
given  maximum  order  n,  with  any  Lp  norm;  this  space  is  preserved  by  the  family  of  rigid 
rotations  of  Sd.  Obviously,  if  both  A and  T are  uniform  under  the  same  family  $,  then 
A approximates  T equally  well  at  all  points  of  ft.  (Of  course,  for  any  specific  function 
/ G /F,  the  error  f - fA  will  usually  vary  over  ft.) 

There  are  however  many  important  approximation  spaces  A which  are  not  uniform.  A 
familiar  example  is  the  space  of  polynomials  or  trigonometric  series  defined  on  a bounded 
region  ft  C Rn.  Another  example  is  the  space  of  the  piecewise  polynomial  splines  of  fixed 
order  and  continuity  defined  over  a fixed  grid  G.  Wavelet  spaces  truncated  to  a fixed 
order  provide  yet  another  example.  For  such  spaces,  the  expected  approximation  error 
usually  varies  over  ft,  even  when  the  functions  to  be  approximated  are  drawn  from  a 
uniform  space. 


over  all  functions  / e 

a*vA,F 
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fA  r df 
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Note  that  integrals  are  taken  over  the  function  space  /F\,  not  over  the  domain  ft. 
The  worst-case  error  is  the  limit 

vXr  = = sup  { \\f  ~fA ||  : / e } • 


2 Approximation  error  map 

We  define  the  root  mean  power  approximation  error  map  of  T by  A as  the  function 
of  ft  to  R defined  by 


/ | f{x)~fA{x)\Pdf 
Jfi  \ 


i i/p 


(2.1) 


As  before,  integrals  are  taken  over  the  function  space  T\,  not  over  the  domain  ft.  Note 
that  x)  is  not  the  error  for  a specific  function  /,  but  rather  the  average  error  at  the 

point  x for  a generic  function  / in  T\.  As  a limiting  case,  we  define  also  the  worst-case 
approximation  error  map  of  T by  A as  the  function 

Va,f(x)  = p]im^aPtA^(x)  = sup  { \f(x)  - fA(x)\  : feT i}.  (2.2) 


Again  note  that  the  supremum  is  taken  over  T\,  not  over  ft,  and  that  pa,f(x)  is  not 
the  error  at  x for  a single  function  /,  but  rather  the  error  for  the  function  / in  /Fi  that 
is  worst  for  that  particular  x.  A plot  of  crPi^,jr(a:)  or  iia,f{x)  over  ft  should  show  at  a 
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glance  how  well  A approximates  T in  different  parts  of  the  domain,  for  all  functions  of 
T at  once. 


3 Computing  the  approximation  error  map 

Formulas  (2.1)— (2.2)  become  more  tractable  when  the  function  metric  ||-||  is  the  L%  norm 
ll/ll  = [Jo  \ f(x)\2  dx]1?2  defined  on  the  space  A+F — in  other  words,  when  ||/||2  = (/,  /) 
where  {/,  g)  = f()  f(x)g(x)  dx.  We  make  this  assumption  in  the  remainder  of  this  section. 
In  that  case,  fA  is  a linear  function  of  /,  namely  the  orthogonal  projection  of  / onto  the 
subspace  A;  and  Pa,f  is  simply  |sin 6\,  where  6 is  the  angle  between  the  two  subspaces. 

3.1  Explicit  formula  for  a 


Let  us  suppose  that  A and  T are  disjoint,  and  let  <j>\, . . . , <j)n  be  an  orthonormal  basis  for 
T . Let  Q'i  = <j>f  for  all  i,  and  let  et  = <f>i  — o,-  ■ We  will  call  <p,  a,  and  e the  gauge , approx- 
imation, and  error  bases,  respectively  (even  though  a,  and  e,  need  not  be  independent). 
The  average  error  map  can  be  expressed  in  terms  of  the  error  basis 


where  An 

Note  that  Yliciei(x)  the  dot  product  of  the  unit  vector  c = (ci,  C2, . . . , cn)  and 
the  vector  e(x)  = (ei(x),£2{x), . . .,en(x));  it  depends  only  on  |er(rc)|  and  on  the  angle  6 
between  those  two  vectors,  and  is  constant  over  the  slice  of  Sn_1  where  0 is  constant. 
The  measure  of  that  slice  is  An-\  Isin#!"-1  dO.  Therefore, 


\ 

V 

i/p  . 

hr 

(*) 

dc 

\ ld° 

/ 

/ Us"-1 

= 4-  [ Y^Cieiix) 

An  J S"-!  ; 


dc 


i/p 


i i/p 


(3.1) 


= 27t  5 /r(|)  is  the  measure  of  S 
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(3.2) 


3.2  Explicit  formula  for  p 

The  worst-case  error  map  Pa.t  can  be  obtained  by  taking  p to  the  limit  +00  in  for- 
mula (3.2),  or  directly,  as  follows.  From  formula  (2.2), 

A uAx)  = supj  (x)  - (x)  : = 1 } 
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= sup|  ^2ci£i(x)  ■ ceSn  1 |.  (3.3) 

^ i ' 

By  considering  the  effect  of  negating  each  Cj,  it  is  easy  to  see  that  the  absolute  value  in 
the  last  formula  is  superfluous,  i.e. 

PA,r(x)  = supj  ^2ciSi(x)  : c £ Sn_1  1.  (3.4) 

Formula  (3.4)  is  the  supremum  of  a linear  functional  with  coefficients  £i(x)  over  the 
sphere  Sn_1;  which  is  achieved  at  the  point  c*  (x)  of  S"-1  that  is  collinear  with  the 

coefficient  vector,  namely  c*(x)  = £i(x)/ (£j ix))2>  whence 

VaAx)  = = A/^Z(er(x))2  = l®(*)l-  (3-5) 

i f 1 

In  summary,  the  error  maps  crP). a,f(x)  and  Pa,t{x)  (which  differ  only  by  a constant 
factor)  can  be  derived  from  the  approximation  errors  £i(x)  for  each  basis  function  <pi(x), 
combined  with  the  norm  |e(a;)|  = \/Yli(£i{x))2 ■ 

4 Practical  considerations 

4.1  Connection  between  the  function  and  point  norms 

The  maps  (2.2)  and  (2.1)  will  be  more  useful  when  there  is  a direct  connection  between 
the  function-space  norm  ||-||  and  the  absolute  value  |-|,  used  to  compare  functions  values 
at  a given  point  x,  as  in  formulas  (2.1)-(2.2) — namely,  when 


More  generally,  the  function  values  at  x could  be  compared  with  a norm  which  could 
depend  on  r,  or  take  derivatives  of  the  function  into  account.  We  will  not  pursue  such 
extensions  in  this  paper. 

Connection  (4.1)  is  not  strictly  necessary — at  least  when  A and  T are  finite  dimen- 
sional. However,  it  may  not  make  much  sense  to  choose  the  approximant  fA  so  as  to 
minimize  the  function  norm  ||-||,  and  then  analyze  its  accuracy  using  some  other  norm 
|-|,  if  there  is  no  connection  between  the  two. 

Considering  that  the  error  map  is  relatively  easy  to  compute  when  ||-||  is  the  L2 
norm  (see  Section  3),  and  probably  intractable  otherwise,  the  connection  expressed  by 
formula  (4.1)  will  probably  hold  in  practice  (with  q = 2). 

4.2  Choice  of  the  gauge  space 

The  approximation  error  map  depends  not  only  on  the  space  A,  but  also  on  the  gauge 
space  T and  the  error  metric  ||/||.  Therefore,  the  choice  of  F and  ||-||  must  be  guided  by 
the  intended  application. 

For  example,  suppose  the  domain  Q,  is  the  circle  or  the  sphere  Sd,  and  the  application 
does  not  specify  a preferred  direction.  Then  we  should  choose  T and  ||-||  so  that  they 
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are  invariant  under  rotations  of  fi — otherwise,  any  inhomogeneity  in  them  may  produce 
irrelevant  artifacts  in  the  error  map.  Also,  if  the  functions  to  be  approximated  are  expec- 
ted to  be  smooth,  and/or  only  their  low  frequencies  are  important,  then  the  functions 
in  F should  be  smooth  too.  A natural  choice  for  F,  in  this  case,  are  the  circular  or 
spherical  harmonics  up  to  a certain  maximum  order,  and  the  metric  ||-||  can  be  simply 
the  Lg  norm  over  the  sphere  Sd. 

4.3  Essential  dimensions 

We  will  argue  next  that,  for  the  L2  function  norm,  the  “interesting”  part  of  the  error 
map  is  determined  by  two  “essential”  subspaces  F'  C F and  A'  C A , which  are  disjoint 
and  such  that  dim^-'  > dim  A7. 

First,  if  the  spaces  A and  F have  a non-trivial  intersection  V,  and  we  split  a function 
/ € F into  its  components  g € V and  h _L  V,  we  find  that  fA  = g + hA;  and  that  hA 
is  itself  orthogonal  to  V.  Therefore,  we  can  confine  our  attention  to  the  complements  F' 
and  A!  of  V relative  to  A and  F,  which  are  disjoint. 

Let  us  then  suppose  that  A and  F are  disjoint.  If  dim  F < dim  A,  let  A'  C A be  the 
projection  of  F onto  A,  which  contains  all  optimum  approximants.  Obviously,  for  any 
function  /,  we  have  fA=zfA,  so  we  can  confine  our  attention  to  the  space  A',  which  is 
still  disjoint  from  F and  satisfies  dim  F > dim  A! . 

5 Examples 

5.1  Trigonometric  splines  on  the  circle 

Consider  the  approximation  of  a function  by  continuous  trigonometric  splines,  of  max- 
imum frequency  r = 2,  defined  on  a partition  T of  S1  into  n = 8 unequal  intervals.  This 
space  coincides  with  the  space  Vq2[T]  of  non-homogeneous  polynomial  splines  of  R2, 
restricted  to  S1,  with  Co  continuity  constraints  [2]. 

For  the  gauge  space  IF,  we  will  use  the  family  of  trigonometric  series  truncated  after 
a suitable  maximum  frequency  s > r,  which  coincides  with  the  space  of  general  spherical 
polynomials  (not  splines)  Vs’2  for  some  s > r.  The  norm  is  ||/||  = y/ (/,  /)  where 
(/,  g)  = Jgi  f(9)g(9)  dp.  Specifically,  T consists  of  the  intervals  /o  through  I7  shown 
below 


to  Io  h I\  t2  h h I3  ti  I4  to  I5  te  Ie  h Ij  t$ 


Within  each  interval  Ij , the  generic  approximant  is  a linear  combination  gj  of  the  Fourier 
basis  functions  (pi,  for  —r<i<  +r.  These  partial  functions  are  constrained  to  be 
continuous  across  interval  boundaries;  i.e.  gj^i(tj)  = g-j{tj)  for  each  j in  {0, . . . , n — 1} 
(where  all  indices  are  taken  modulo  n).  These  equations  turn  out  to  be  independent, 
therefore  the  dimension  of  A is  n(2r  + 1)  — n = 32. 

For  the  gauge  space  F,  we  will  use  the  trigonometric  polynomials  of  some  order 
s > r,  i.e.  linear  combinations  of  the  basis  functions  <f>i  for  -s  <i  < +s,  where  </>i(0)  = 
(l/\/7r)  sin(i#-|-7r/4).  As  observed  in  Section  4.3,  we  can  ignore  the  subspace  A!  = Ff\A  of 
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A generated  by  <p~r,  ■ ■ ■ Moreover,  in  order  to  use  all  of  A,  we  need  dim  T > dim  A — 
i.e.,  2s + 1 > 32,  implying  s > 16.  See  Figure  1.  The  resulting  error  map  I-Ia,t{x)  is  shown 
in  Figure  2. 


to  tl  t2  t3  t4  t5  t6  t7  t8 


Fig.  1.  The  functions  <pi(t),  a,(f),  and  for  selected  values  of  i. 


Fig.  2.  The  error  map  PA,F{t)  for  continuous  (Co)  trigonometric  splines  on  eight  un- 
equal intervals,  tested  with  the  space  of  trigonometric  polynomials  of  order  16. 

5.2  Spherical  splines  on  a uniform  mesh 

For  the  examples  in  this  section,  the  approximating  functions  are  spherical  polynomial 
splines  [1,  2,  3,  4]  of  continuity  class  zero  and  various  degrees,  homogeneous  and  non- 
homogeneous,  defined  on  some  triangulation  T of  the  sphere  S2. 

Figure  3 (left)  shows  the  approximation  error  map  Pa}f{p)  f°r  the  homogeneous 
spherical  spline  space  A = Hq\T]/ S2,  which  has  dimension  252.  In  Figure  3 (right),  A 
is  the  non-homogeneous  spherical  spline  space  Vq[T]/S2,  which  has  dimension  254.  In 
both  cases,  the  gauge  space  T is  the  family  yf5  of  spherical  harmonics  of  maximum  order 
15,  which  has  dimension  256.  The  intersection  T fl  Hq[T]/ S2  is  the  family  of  spherical 
harmonics  of  odd  order  < 5 (dimension  21),  whereas  T Pi  Vq[T]/S2  is  the  full  harmonic 
space  y'l  (dimension  25).  The  level  curves  are  logarithmically  spaced,  five  per  decade. 
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Fig.  3.  Error  maps  Ha,f{p)  for  the  approximation  spaces  A = Hl[T]/S2  (left)  and 
A = Vq[T]/S2  (right).  The  maximum  errors  are  13.5  and  9.37,  respectively. 

5.3  Spherical  splines  on  a variable  mesh 

In  the  following  examples,  the  approximating  functions  are  again  spherical  polynomial 
splines,  but  the  vertices  of  the  triangulation  T have  been  displaced  so  as  to  create  regions 
of  very  different  sizes  (still  with  icosahedral  topology). 

Figure  4 (left)  shows  the  approximation  error  map  pa,t{p)  for  the  space  of  homogen- 
eous spherical  splines  A — Hq\T}/S2,  which  has  dimension  252.  In  Figure  4 (right),  A 
is  the  space  of  non-homogeneous  spherical  splines  Vq  [T']/S2,  which  has  dimension  254. 
In  both  cases,  the  gauge  space  T is  the  family  3*5  of  spherical  harmonics  of  maximum 
order  15,  which  has  dimension  256,  as  before.  The  level  curves  are  logarithmically  spaced 
(5  per  decade). 

6 Conclusion 

Asymptotic  error  analysis  is  not  very  helpful  when  comparing  two  fixed  finite-dimensional 
approximation  spaces  of  similar  dimensions — such  as  a spline  space  against  a wavelet 
space,  or  two  spline  spaces  with  different  grid  geometries.  Approximation  errors  com- 
puted for  individual  test  functions  are  difficult  to  interpret  and  may  not  be  representative 
of  the  average  or  worst  cases.  We  expect  that  the  approximation  error  map  will  be  a use- 
ful analysis  tool  for  those  situations — especially  for  domains  that  admit  natural  uniform 
target  spaces,  such  as  spheres  (including  the  circle)  and  tori. 
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Fig.  4.  Error  maps  for  the  approximation  spaces  A = Hq[T]/S2  (left)  and 

A = Vq[T]/S2  (right).  The  maximum  errors  are  17.1  and  17.9,  respectively. 
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